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(54) Image-sensing apparatus 

(57) An image-sensing apparatus has an area sen- 
sor 1 that outputs innage data by logarithmically convert- 
ing the brightness of iight incident thereon, a black-level 
detector 2 for detecting the black level BL of the image 
data at which the image data has the lowest signal level, 
a white-level detector 3 for detecting the white level WL 
of the image data at which the image data has the high- 
est signal level, a calculation formula determiner 4 for 



detemnining, in accordance with the detected black and 
white levels BL and WL, the formula to be used to con- 
vert the signal level of the image data, and a dynamic 
range converter 5 for converting the signal level of the 
image data using the calculation formula determined by 
the calculation formula determiner 4. 



FIG.1 



AREA 
SENSOR 



1 



IMAGE 
DATA 



5> 



HI 



BLACK-LEVEL 
DETECTOR 



WHITE-LEVEL 
DETECTOR 



DYNAMIC 
RANGE 
CONVERTER 



^WL 



BL 



CALUCULATION 
FORMULA 



CALUCULATION 
FOUMURLA 
DETERMINER 



OUTPUT 
DEVICE 



4 



Q. 

LU 



Printed by Xerox (UK) Business Services 
2.16.7 (HRS)/3.6 



BNSDOCID: <EP 10S284eA1J_> 



1 



EP 1 052 848 A1 



2 



Description 

[0001] This application is based on applications 
Nos. H1 1-128384 and 2000-090683 filed in Japan on 
May 10, 1999 and March 27, 2000 respectively, the 
entire content of which is hereby incorporated by refer- 
ence. 

BACKGROUND OF THE INVENTION 

Field of the Invention 

[0002] The present invention relates to an image- 
sensing apparatus having a photoelectric conversion 
device that outputs a signal that is logarithmically pro- 
portional to the amount of incident light. 

Description of the Prior Art 

[0003] A conventional area sensor having photo- 
sensitive devices such as photodiodes outputs a signal 
that is linearly proportional to the brightness of the light 
incident on the photosensitive devices as shown at (a) 
in Fig. 15. When a subject having brightness distribution 
as shown at (b) in Fig. 1 5 is shot with such a linear-con- 
version-based area sensor (hereafter referred to as a 
"linear sensor"), no brightness data is obtained outside 
the roughly two-digit brightness range (dynamic range) 
within which the linear sensor can effectively perform 
image sensing (this brightness range will hereinafter be 
referred to as the "shootable brightness range"). 
[0004] Accordingly, when the signal from this linear 
sensor is reproduced as an image on a display or the 
like, the displayed image suffers from fiat blackness in 
low-brightness portions thereof and saturation in high- 
brightness portions thereof outside the shootable 
brightness range. It is possible to avoid flat blackness by 
shifting the shootable brightness range leftward or avoid 
saturation by shifting it rightward. However, this requires 
varying the aperture value or shutter speed of a cam- 
era, or the integral time for which to allow light in, and 
thus spoils ease of use. 

[0005] On the other hand, in Japanese Laid-Open 
Patent Application No. H3-1 92764, the applicant of the 
present invention once proposed an area sensor (here- 
inafter referred to as a "LOG sensor") provided with a 
light-sensing means that outputs a photocurrent in pro- 
portion to the amount of incident light, a MOS transistor 
to which the photocurrent is fed, and a bias means for 
biasing the MOS transistor in such a way that a sub- 
threshold current flows therethrough, so that the photo- 
current is converted logarithmically. This LOG sensor 
outputs a signal whose level is natural-logarithmically 
proportional to the amount of incident light as shown at 
(a) in Fig. 1 6, and thus offers a wide, specifically five- to 
six-digit, dynamic range. This permits, even in cases in 
which the brightness distribution tends to shift, the 
brightness distribution of a given subject to lie most 



probably within the shootable brightness range as 
shown at (b) in Fig. 1 6. 

[0006] However, a typical subject has a two- to 
three-digit brightness range, and therefore, if it is shot 

5 with a LOG sensor that offers a five- to six-digit dynamic 
range, the shootable brightness range is too wide rela- 
tive to the actual brightness distribution of the subject, 
and thus a region where no brightness data Is available 
is left in a low-brightness or high-brightness portion of 

10 the shootable brightness range. Specifically, as shown 
at (a) in Fig. 16, with respect to the dynamic range DRa 
of the LOG sensor, the range DRb of the output that cor- 
responds to the brightness distribution of the subject is 
considerably narrow. Thus, when the output signal of 

15 this LOG sensor is subjected to level conversion so as 
to be converted, for example, into an eight-bit digital sig- 
nal as shown in Fig. 17 in order to display an image on 
an output device such as a display, if conversion is so 
performed that the dynamic range DRc of the output 

20 device is adapted to the dynamic range DRa of the LOG 
sensor and that the maximum and minimum output val- 
ues of the LOG sensor correspond to the maximum and 
minimum output levels (255 and 0), respectively, of the 
output device, the output device receives a signal 

25 whose level varies only within a range DRd which is 
merely a portion of the range covered by the eight-bit 
digital signal. Thus, when the image of a subject having 
brightness distribution as described above is repro- 
duced using such a signal, the black portions of the 

30 image, where the brightness is lowest, are reproduced 
as dark gray, and the white portions thereof, where the 
brightness is highest, are reproduced as light gray, mak- 
ing the entire image low-contrast 

35 SUMMARY OF THE INVENTION 

[0007] An object of the present invention is to pro- 
vide an image-sensing apparatus that performs signal 
processing in such a way as to adapt the dynamic range 
40 of an image shot with a LOG sensor to the dynamic 
range of an output device. 

[0008] To achieve the above object, according to 
the present invention, an image-sensing apparatus is 
provided with: a photoelectric conversion device, having 

45 a plurality of photosensitive devices that produce elec- 
tric signals in accordance with the brightness of light 
incident thereon, for converting logarithmically the elec- 
tric signals produced by the individual photosensitive 
devices; a determiner for detemriining the brightness 

so range of a subject: and a converter for perfonning level 
conversion on the electric signals output from the photo- 
electric conversion device in such a way that the bright- 
ness range of the subject as determined by the 
determiner is adapted to the dynamic range of an output 

55 device used to reproduce an image. 

[0009] With this image-sensing apparatus, even if 
the subject shot has a brightness range narrower than 
the dynamic range of an area sensor used as the pho- 
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toelectric conversion device, the output level of the sen- 
sor is converted in such a way that the brightness range 
of the subject is adapted to the dynannic range of the 
output device, and thus it is possible to feed the output 
device with a signal that confonns to the dynamic range 5 
of the output device. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0010] This and other objects and features of the 10 
present invention will become clear from the following 
description, tal^en in conjunction with the preferred 
embodiments with reference to the accompanying 
drawings in which: 

15 

Fig. 1 is a block diagram showing the Internal con- 
figuration of the image-sensing apparatus of a first 
embodiment of the invention; 

Fig. 2 is a graph showing the relationship among 20 
the brightness distribution of a subject, the level of 
the input signal to the output device, and the level of 
the output signal from the area sensor; 



ness distribution; 

Fig. 1 3 is a diagram showing an example of bright- 
ness distribution; 

Fig. 1 4 is a graph showing the relationship between 
the brightness distribution of a subject and the 
brightness range obtained by the image-sensing 
apparatus of a fifth embodiment of the invention; 

Fig. 15 is a graph showing the relationship among 
the brightness distribution of a subject, the level of 
the input signal to an output device, and the level of 
the output signal from an area sensor; 

Fig. 16 is a graph showing the relationship among 
the brightness distribution of a subject, the level of 
the input signal to an output device, and the level of 
the output signal from an area sensor; and 

Rg. 17 is a diagram showing the relationship 
between the dynamic range of a LOG sensor and 
the level of the signal fed to an output device. 

DESCRIPTION OF THE PREFERRED EMBODI- 
MENTS 

<First Embodiment) 

[0011] A first embodiment of the present invention 
will be described below with reference to the relevant 
drawings. Fig. 1 is a block diagram showing the config- 
uration of the image-sensing apparatus of this embodi- 
ment. This image-sensing apparatus is of a type that 
employs a logarithm-conversion-based area sensor 
(LOG sensor) and that permits shooting of a subject in 
motion. 

[0012] The image-sensing apparatus shown in Rg. 
1 has an area sensor 1 that has pixels, realized with 
photosensitive devices, arranged in a matrix and that 
produces an electric signal (hereafter referred to as the 
"image data") by logarithmically converting the bright- 
ness of light incident thereon, a black-level detector 2 
that detects, among a plurality of pixels constituting the 
image data, the signal level of that pixel which shows 
the lowest signal level (hereafter referred to as the 
"black level"), a white-level detector 3 that detects, 
among the plurality of pixels constituting the image 
data, the signal level of that pixel which shows the high- 
est signal level (hereafter referred to as the "white 
level"), a calculation formula determiner 4 that deter- 
mines, using the black and white levels detected by the 
black-level and white-level detectors 2 and 3, the calcu- 
lation formula to be used by a dynamic range converter 
5. a dynamic range converter 5 that performs calcula- 
tion on the image data output from the area sensor 1 
using the calculation formula determined by the calcula- 
tion fomnula determiner 4, and an output device 6, such 



Fig. 3 is a diagram showing the relationship 25 
between the dynamic range of the area sensor and 
the level of the signal fed to the output device; 

Fig. 4 is a block diagram showing the internal con- 
figuration of the image-sensing apparatus of a sec- 30 
ond embodiment of the Invention; 

Fig. 5 is a graph showing the relationship among 
the brightness distribution of a subject, the level of 
the Input signal to the output device, and the level of 35 
the output signal from the area sensor; 

Fig. 6 is a block diagram showing the Internal con- 
figuration of the image-sensing apparatus of a third 
embodiment of the invention; 40 

Fig. 7 is a block diagram showing the internal con- 
figuration of the image-sensing apparatus of a 
fourth embodiment of the invention; 

45 

Fig. 8 is a flow chart showing the operation of the 
brightness range setter; 

Fig. 9 is a diagram showing an example of bright- 
ness distribution; so 

Figs. 1 0A to 1 GO are diagrams showing examples 
of brightness distribution; 

Rg. 1 1 is a diagram showing an example of bright- ss 
ness distribution; 

Fig. 12 is a diagram showing an example of bright- 
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as a display, on which an image is reproduced on the 
basis of the image data that has gone through the cal- 
culation performed by the dynamic range converter 5. 
The output device 6 may be provided as a separate unit, 
in which case connection therewith is achieved by way 
of a connection cable (not shown). 
[0013] In this image-sensing apparatus configured 
as described above, when image data corresponding to 
one frame is fed from the area sensor 1 to each of the 
black-level and white-level detectors 2 and 3, they 
detect from this image data corresponding to one frame 
the black level and the white level, respectively. Here, 
the shootabte brightness range of the area sensor 1 and 
the brightness distribution of the subject have a relation- 
ship as shown at (a) in Fig. 2, where the brightness that 
corresponds to the black level detected by the black- 
level detector 2 is marked PA and the brightness that 
corresponds to the white level detected by the white- 
level detector 3 is marked PB. These brightness values 
PA and PB con^espond to BL and WL. respectively, at 
(b) in Fig. 2. 

[0014] At (b) in Fig. 2 is shown the relationship 
between the level of the output signal from the area sen- 
sor 1 (taken along the horizontal axis) and the level of 
the signal fed to the output device 6 (taken along the 
vertical axis). Here, the characteristic (A) indicated by a 
dotted line is the characteristic of the output device 
obtained when the output signal from the area sensor 1 
is used intact. In this case, a dynamic range DR1 is 
obtained, with the maximum and minimum values at Ma 
and Mi. This dynamic range DR1 covers input levels 
ranging from Wa to Wb, which corresponds to the entire 
shootable brightness range of the area sensor 1 . Thus, 
if image data having brightness distribution as shown at 
(a) in Rg. 2 is used intact, the output signal from the 
area sensor 1 lies within the range BL-WL, which lies 
inside the entire range covered by the characteristic (A). 
This makes the range DR2 of the signal fed to the output 
device 6 unnecessarily narrow, and makes the output 
image low-contrast as described earlier. To avoid this, in 
this embodiment, the output signal from the area sensor 
1 is subjected to calculation that corrects the character- 
istic (A) to the characteristic (B) indicated by a solid line. 
This calculation is performed using a calculation for- 
mula like 

Ma - Mi / X V 

y = wi:TBr(''-BL) (1) 



where x and y are variables that represent the levels 
taken along the horizontal and vertical axes, respec- 
tively, at (b) in Fig. 2. 

[0015] This calculation formula (1), or a similar for- 
mula, is given from the calculation fonmula determiner 4 
to the dynamic range converter 5, so that the dynamic 
range converter 5 substitutes the signal level of the 
image data fed from the area sensor 1 as x in the calcu- 



lation formula (1) and thereby converts the signal level 
into y. This conversion permits the image data, having a 
range BL-WL, output from the area sensor 1 to be con- 
verted into image data having signal levels adapted to 

5 the dynamic range DR1 of the output device 6 as shown 
in Fig. 3. That is, whereas the signal fed to the output 
device 6 has a range DR2 when the output signal from 
the area sensor 1 is used intact as described previously, 
in this embodiment this range is expanded to a range 

10 DR1 , which conforms to the dynamic range of the out- 
put device 6. This helps prevent a region from being left 
within the shootable brightness range where no part of 
the brightness range of the subject lies, and thereby 
permits the output device 6 to output a satisfactory high- 

is contrast image, 

[001 6] Here, the dynamic range converter 5 may be 
provided with a delay circuit so that, when it is given a 
calculation formula like the calculation formula (1) from 
the calculation formula determiner 4, it can perform cal- 

20 culation on the image data of the same frame that was 
used to determine the calculation formula. Alternatively, 
the dynamic range converter 5 may perform calculation 
on image data using the calculation formula determined 
on the basis of the image data of the previous frame. In 

25 cases where quick response is not required in reflecting 
the result of calculation, the calculation formula may be 
detennined every predetermined number of frames so 
that the dynamic range converter 5 continues perform- 
ing calculation on image data using the calculation for- 

30 mula determined previously until a new one is 
detenmined next time. 

(Second Embodiment) 

35 [0017] A second embodiment of the present inven- 
tion will be described below with reference to the rele- 
vant drawings. Rg. 4 Is a block diagram showing the 
configuration of the image-sensing apparatus of this 
embodiment. It is to be noted that, in the following 

4o descriptions of this embodiment, such blocks as serve 
the same purposes as in Fig. 2 are identified with the 
same reference numerals, and their detailed descrip- 
tions will be omitted. 

[0018] The image-sensing apparatus shown in Fig. 

45 4 has an area sensor 1, a black-level detector 2, a 
white-level detector 3, a calculation fomnula determiner 
4, a dynamic range converters, an output device 6, and 
a brightness distribution evaluator 7 for evaluating the 
brightness distribution (histogram) of the image data 

50 output from the area sensor 1 . 

[0019] In this image-sensing apparatus configured 
as described above, when image data corresponding to 
one frame is fed from the area sensor 1 to the bright- 
ness distribution evaluator 7, the signal levels of the 

55 individual pixels constituting this image data corre- 
sponding to one frame are measured so that the fre- 
quencies of different signal levels within the image data 
are counted. That is, how many of the pixels of the area 
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sensor 1 are illuminated with light of a particular bright- 
ness value is counted for each of possible brightness 
values. In this way, by counting the frequencies of differ- 
ent brightness values in the image data of a subject, the 
brightness distribution evaluator 7 evaluates the bright- 
ness distribution of the subject. 

[0020] Moreover, the brightness distribution evalua- 
tor 7 calculates the sunnnnation of the signal levels of all 
of the pixels constituting the image data corresponding 
to one frame in order to calculate the integral of the 
brightness distribution In the Interval between bright- 
ness PA and brightness PB shown at (a) in Fig. 5 (this 
value will hereafter be referred to as "the value of the 
area of the entire brightness distribution"). Here, 
assume that this value is equal to Z, and that, to simplify 
the explanation, the brightness values PA and PB are 
defined in the same manner as in the first embodiment. 
At the brightness PA and PB, the Image data has levels 
BL and WL, respectively, as shown at (b) in Rg. 5. 
[0021] When this value Z representing the value of 
the area of the entire brightness distribution is calcu- 
lated, It is fed to the black-level and white-level detectors 
2 and 3. Moreover, at this time, the brightness distribu- 
tion evaluator 7 feeds the image data of the sensed 
frame, on the one hand starting with that of the pixels 
showing the lowest signal level upward, to the black- 
level detector 2 and, on the other hand starting with that 
of the pixels showing the highest signal level downward, 
to the white-level detector 3. 

[0022] On receiving the image data from the bright- 
ness distribution evaluator 7, the black-level and white- 
level detectors 2 and 3 each add together the signal lev- 
els of the image data one after another in the order in 
which they receive them. When the value of the added- 
up signal levels reach a percent of the value Z, i.e. 
a X Z / 100 , the black-level and white-level detectors 2 
and 3 detect the signal level of the image data at that 
moment. This value a may be specified from the out- 
side, or may be stored beforehand in memory (not 
shown) or the like. It is also possible to specify different 
values of a for the black-level and white-level detectors 
2 and 3. 

[0023] The levels of the image data thus detected in 
the black-level and white-level detectors 2 and 3 are 
used as the black level and the white level, respectively. 
The black and white levels detected here are marked 
BL1 and WL1 at (b) in Fig. 5. Thus, at (a) in Fig. 5, these 
black and white levels BL1 and WL1 correspond to the 
brightness marked PA1 and PB1 , respectively. Accord- 
ingly, in the brightness distribution shown at (a) in Fig. 5, 
the value a x Z / 100 corresponds to one of the por- 
tions thereof covering brightness from PA to PA1 and 
from PB to PB1 , of which each has an area that is equal 
to a percent of the value of the area of the entire bright- 
ness distribution. 

[0024] Then, as in the first embodiment, the calcu- 
lation fonnula determiner 4 determines a calculation for- 
mula that is the same as the calculation fomnula (1) 



used in the first embodiment except that the black and 
white levels BL1 and WL1 are used instead of the black 
and white levels BL and WL. Subsequently, as in the 
first embodiment, using the thus determined calculation 

5 formula, the dynamic range converter 5 performs calcu- 
lation on the Image data output from the area sensor 1 . 
[0025] With this image-sensing apparatus operat- 
ing as described above, even if the subject has bright- 
ness distribution with gentle slopes (indicating small 

10 variation in the frequencies of different brightness val- 
ues) in hem portions of the distribution curve (i.e. in 
high-brightness and low-brightness end portions 
thereof), it is possible to cut such hem portions so that 
conversion is performed in such a way that the image 

15 data is output with more stable contrast. Of course, 
even with a subject having brightness distribution that 
corresponds to a three-digit or wider dynamic range, it is 
possible to cut hem portions so that conversion is per- 
formed in such a way that the image data is output with 

20 more stable contrast, and thus it is possible to shoot the 
subject properiy without fear of flat blackness or satura- 
tion. Moreover, since image data is obtained as an out- 
put signal from a LOG sensor, it is possible to cope with 
a subject having a dynamic range too wide to be shot 

25 with a conventional linear sensor. 

(Third Embodiment) 

[0026] A third embodiment of the present invention 
30 will be described below with reference to the relevant 
drawings. Fig. 6 is a block diagram showing the config- 
uration of the image-sensing apparatus of this embodi- 
ment. It is to be noted that, in the following descriptions 
of this embodiment, such blocks as serve the same pur- 
35 poses as in Fig. 1 are identified with the same reference 
numerals, and their detailed descriptions will be omit- 
ted. 

[0027] The image-sensing apparatus shown in Rg. 
6 has an area sensor 1, a calculation formula deter- 

40 miner 4, a dynamic range converter 5, an output device 
6, a black-level feeder 8 for allowing entry of a black- 
level value from the outside, and a white-level feeder 9 
for allowing entry of a white -level value from the outside. 
[0028] In this image-sensing apparatus, a black 

45 level BL2 and a white level WL2 are entered into the 
black-level and white-level feeders 8 and 9 from the out- 
side by the user in accordance with the brightness 
range that the user desires. The black and white levels 
BL2 and WL2 entered into the black-level and white- 

50 level feeders 8 and 9 are then fed to the calculation for- 
mula detenniner 4. Thus, the calculation fonnula deter- 
miner 4 determines a calculation formula that is the 
same as the calculation formula (1) used in the first 
embodiment except that the black and white levels BL2 

55 and WL2 are used instead of the black and white levels 
BL and WL. Subsequently, as in the first embodiment, 
using the thus determined calculation formula, the 
dynamic range converter 5 performs calculation on the 
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image data output from the area sensor 1 . 
[0029] This image-sensing apparatus pemnits the 
user to enter a black level and a white level. Thus, the 
user can set the brightness range as desired while 
observing an image displayed on the output device 6 
such as a display, and can thus obtain an image to his 
or her liking. 

(Fourth Embodiment) 

[0030] A fourth embodiment of the present inven- 
tion will be described below with reference to the rele- 
vant drawings. Fig. 7 is a block diagram showing the 
configuration of the image-sensing apparatus of this 
embodiment. It is to be noted that, in the following 
descriptions of this embodiment, such blocks as serve 
the same purposes as in Fig. 4 are identified with the 
same reference numerals, and their detailed descrip- 
tions will be omitted. 

[0031] The image-sensing apparatus shown in Fig. 
7 has an area sensor 1 , a calculation formula deter- 
miner 4, a dynamic range converter 5, an output device 
6, a brightness distribution evaluator 7, and a brightness 
range setter 10 that determines the brightness range of 
a subject in accordance with the shape of the bright- 
ness distribution evaluated by the brightness distribu- 
tion evaluator 7. In this embodiment, the brightness 
range that is fed to the output device is determined not 
solely on the basis of the maximum and minimum val- 
ues of the brightness distribution of the subject, but also 
in consideration of the shape of the brightness distribu- 
tion. 

[0032] Fig. 8 is a flow chart showing the flow of 
operations performed by the brightness range setter 10 
to determine a brightness range. Fig. 9 shows an exam- 
ple of brightness distribution, with brightness taken 
along the horizontal axis and the frequencies of different 
brightness values taken along the vertical axis. In the 
following descriptions, on a curve defining a particular 
brightness distribution, a point that corresponds to a 
maximum value is referred to as a "ridge" and a point 
that corresponds to a minimum value is referred to as a 
"trough"; the frequency observed at a ridge is referred to 
as "the height of the ridge" and the frequency observed 
at a trough is refen-ed to as "the height of the trough"; 
the portions of the brightness distribution near both 
ends thereof, where the frequencies observed are 
largely low, are called "hem portions". Thus, in Fig. 9, a 
indicates the width of a brightness range, b indicates 
the number of ridges, c indicates the height of ridges, d 
indicates the height of troughs, and e indicates the hem 
portions of the distribution curve. 
[0033] As in the second embodiment, when image 
data corresponding to one frame is fed from the area 
sensor 1 to the brightness distribution evaluator 7, the 
brightness distribution evaluator 7 evaluates the bright- 
ness distribution of the subject Subsequently, when the 
brightness distribution evaluated by the brightness dis- 



tribution evaluator 7 is fed to the brightness range setter 
1 0, first, the number of ridges is counted (STEP 1). If the 
number of ridges thus counted is one as shown in Fig. 
IDA (Yes), the operation flow proceeds to STEP 15; if 

5 the number of ridges is more than one as shown in Rg. 
10B (No), the operation flow proceeds to STEP 3 (STEP 
2). When the operation flow proceeds from STEP 2 to 
STEP 3, the height of the trough is measured. If the ratio 
of the height of the trough measured here to the height 

70 of the lower one of the two ridges adjacent thereto is 
greater than a threshold value Ta (Yes), the operation 
flow proceeds to STEP 5; if that ratio is less than the 
threshold value Ta (No), the operation flow proceeds to 
STEP 6 (STEP 4). That is, in the case shown in Rg. 

15 10B, in STEP 4, whether the ratio (d1) / (c1) of the 
height d1 of the trough B to the height of the lower one 
of the ridges A and C adjacent thereto is greater than Ta 
or not is checked. 

[0034] When the operation flow proceeds from 

20 STEP 4 to STEP 5, instead of regarding the lower ridge 
as an independent ridge, the two ridges adjacent to the 
trough is regarded as a single ridge as a whole. That is, 
in Fig. 10B, if the trough B is so high that the ratio of its 
height to the height of the lower ridge A is greater than 

25 the threshold value Ta, the lower ridge A is regarded no 
longer as an independent ridge but as part of the higher 
ridge C. When the operation flow proceeds from STEP 
4 to STEP 6, the two ridges adjacent to the trough are 
regarded as separate and thus independent ridges. 

30 That is, in Fig. 1 0B, if the trough B is so low that the ratio 
of its height to the height of the lower ridge A is lower 
than the threshold value Ta, the ridges A and C are 
regarded as independent ridges. 
[0035] When, in STEP 6, the two ridges adjacent to 

35 the trough are found to be separate from each other, 
then, if any of those two ridges has a brightness range 
narrower than a threshold value Tb, it is no longer 
regarded as a ridge and is excluded from the brightness 
distribution (STEP 7). Here, the brightness range of a 

40 ridge is defined as the range between the brightness 
values at the two troughs adjacent thereto, or alterna- 
tively, in the case of a ridge located at one end of the 
brightness distribution, as the range between that end 
and the brightness value at the trough adjacent to the 

45 ridge on the opposite side thereof. Thus, if, as shown In 
Fig. 10C, the brightness range el of the ridge A is wider 
than the threshold value Tb, and the brightness range 
e2 of the ridge C is narrower than the threshold value 
Tb, the ridge C is no longer regarded as a ridge and is 

50 excluded from the brightness distribution. 

[0036] When the operation flow proceeds from 
STEP 5 or STEP 7 to STEP 8, whether all the troughs 
within the evaluated brightness distribution have 
already been subjected to the operations In STEP 3 to 

55 STEP 7 or not is checked. If all the troughs have already 
been subjected to the operations in STEP 3 to STEP 7 
(Yes), the operation flow proceeds to STEP 9; if any of 
the troughs has not yet been subjected to those opera- 
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tions (No), the operation flow returns to STEP 3 to 
repeat those operations. 

[0037] In STEP 9, the number of ridges is counted 
once again. If the number of ridges counted here Is one 
(Yes), the operation flow proceeds to STEP 15; if the 
number of ridges is more than one (No), the operation 
flow proceeds to STEP 11 (STEP 10). In STEP 11. 
whether the number of ridges is two or not is checked. If 
the number of ridges is two (Yes), the operation flow 
proceeds to STEP 12; if the number of ridges is three or 
more (No), the operation flow proceeds to STEP 14. In 
STEP 12, whether the area ratio calculated by dividing 
the area of the ridge having the larger area by that of the 
ridge having the smaller area is greater than a threshold 
value Tc or not is checked. If this area ratio is greater 
than the threshold value Tc (Yes), the operation flow 
proceeds to STEP 13, where the ridge having the 
smaller area is excluded from the brightness distribu- 
tion; if the area ratio is smaller than the threshold value 
Tc (No), the operation flow proceeds to STEP 15. 
[0038] In STEP 13, the ridge having the smaller 
area is excluded from the brightness distribution, and 
the remaining portion is determined as the effective 
region. That is, as shown in Fig. 11, if, in STEP 9, two 
ridges A1 and A2 are recognized, their respective areas 
SI and S2 are calculated, and then, since SI < S2 here, 
the area ratio (S2) / (SI ) is compared with the threshold 
value Tc (STEP 12). In this case, if the area ratio (S2) / 
(SI) is greater than the threshold value Tc, the ridge A1 
having the smaller area is excluded from the brightness 
distribution, and thus the brightness distribution is 
regarded as being formed by the ridge A2. Here, the 
area of a ridge is defined as the integral with respect to 
brightness of the frequencies of different brightness val- 
ues between the troughs adjacent thereto, or alterna- 
tively, in the case of a ridge located at one end of the 
brightness distribution, as the integral with respect to 
brightness of the frequencies of different brightness val- 
ues between that end and the trough adjacent to the 
ridge on the opposite side thereof. 
[0039] In STEP 14, out of the ridges still regarded 
as ridges, the one having the largest area is selected as 
the reference, and, in order of decreasing distance to 
this reference ridge, the area ratio calculated by dividing 
the area of each of the other ridges by the area of the 
reference ridge having the largest area is compared, 
one after another, with a threshold value Td. Here, any 
ridge of which the area ratio is smaller than the thresh- 
old value Td is no longer regarded as a ridge, and is 
excluded from the brightness distribution. When ridges 
of which the area ratios are larger than the threshold 
value Td are found on both sides, i.e. lower-brightness 
and higher-brightness sides, of the reference ridge hav- 
ing the largest area, the portion remaining at that 
moment is determined as the effective region, and the 
operation flow is ended. That is, as shown in Fig. 1 2, if, 
in STEP 9, four ridges B1 to B4 are recognized, their 
respective areas Sa to Sd are calculated, and, when the 



area Sc is the largest of all these areas, the area ratios 
(Sa) / (Sc), (Sd) / (Sc), and (Sb) / (Sc) are compared, in 
this order, with the threshold value Td. Here, relative to 
the ridge B3, the ridges 81 , 84, and 82 are so located 
5 that their distances to the ridge 83 increases in the 
order named. 

[0040] Here, assume that the area ratio (Sa) / (Sc) 
is smaller than the threshold value Td, and that the area 
ratios (Sd) / (Sc) and (Sb) / (Sc) are greater than the 

10 threshold value Td. In this case, first, the ridge 81 is 
checked, and its area ratio is found to be smaller than 
the threshold value Td. Thus, the ridge 81 is no longer 
regarded as a ridge and is thus excluded from the 
brightness distribution. Next, the ridge 84 is checked, 

15 and its area ratio is found to be greater than the thresh- 
old value Td. Thus, the checking of the ridges that are 
located on the higher-brightness side of the ridge 83 is 
ended. Next, the ridge 82 is checked, and its area ratio 
is found to be greater than the threshold value Td. Thus, 

20 the checking of the ridges that are located on the lower- 
brightness side of the ridge 83 is ended. When the 
operation in STEP 14 is completed in this way, the oper- 
ation flow proceeds to STEP 15. 
[0041] In STEP 15. the area of the ridges excluded 

25 from the brightness distribution is subtracted from the 
area of the entire brightness distribution, and the area 
that remains thereafter is determined as the effective 
area. That is, if only one ridge is recognized in STEP 2 
or STEP 10, or if the area ratios of two ridges are 

30 smaller than the threshold value Tc in STEP 12, then 
the entire brightness distribution is determined as the 
effective area; on the other hand, when the operation 
flow proceeds from STEP 13 or STEP 14 to STEP 15, 
the area that remains after subtracting the area of the 

35 ridges excluded from the brightness distribution in 
STEP 13 or STEP 14 from the area of the entire bright- 
ness distribution is determined as the effective area. 
Thus, the effective area Is the area of the effective 
region mentioned above. 

40 [0042] When the effective area is determined in this 
way, on the basis of what portion of the brightness dis- 
tribution forms the effective area, the hem portions are 
determined. That is, as shown in Fig. 13, the brightness 
PA2 at which the value obtained by integrating the fre- 

45 quencies of different brightness values with respect to 
brightness from the lowest brightness upward within the 
portion of the brightness distribution that forms the 
effective area becomes equal to a percent of the effec- 
tive area is calculated, and also the brightness PB2 at 

so which the value obtained by integrating the frequencies 
of different brightness values with respect to brightness 
from the highest brightness downward within the portion 
of the brightness distribution that forms the effective 
area becomes equal to a percent of the effective area is 

55 calculated. Then, the portion si con-esponding to 
brightness lower than the brightness PA2 and the por- 
tion s2 corresponding to brightness higher than the 
brightness P82 are determined as the hem portions. 
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[0043] The hem portions thus determined are 
removed from the brightness distribution, and the 
brightness range that remains thereafter In the bright- 
ness distribution is determined as the brightness range 
of the subject (STEP 17). That is, in Fig. 13. the bright- 
ness range from the brightness PA2 (corresponding to 
the black level BL3) to the brightness PB2 (correspond- 
ing to the white level WL3) is detenmined as the bright- 
ness range of the subject. In cases where, like the 
region Sc shown in Fig. 12, the effective region has a 
shape having hem portions already removed, the bright- 
ness at both ends of the effective region may be used as 
the upper and lower limits of the brightness range of the 
subject (that is, it is assumed that a = 0 percent). 
[0044] On the basis of the thus determined bright- 
ness range, as in the second embodiment, the black 
level BL3 corresponding to the brightness PA2 and the 
white level WL3 corresponding to the brightness PB2 
are fed to the calculation formula determiner 4 to make 
it determine a calculation formula to be used to deter- 
mine a dynamic range. Subsequently, using the calcula- 
tion formula thus determined, the dynamic range 
converters performs calculation on the image data out- 
put from the area sensor 1 . 

[0045] By determining the brightness range of a 
subject in accordance with the shape of the brightness 
distribution in this way, it is possible to detemiine proper 
brightness ranges with subjects having different bright- 
ness distribution, and thus shoot various subjects prop- 
erly. 

(Fifth Embodiment) 

[0046] A fifth embodiment of the present invention 
will be described below with reference to the relevant 
drawings. Rg. 14 is a graph showing the relationship 
between the brightness distribution of a subject and the 
brightness range obtained by the image-sensing appa- 
ratus of this embodiment. The image-sensing apparatus 
of this embodiment has the same internal configuration 
as that of the second embodiment shown in Fig. 4. 
[0047] In this embodiment, the area sensor 1 , the 
calculation formula determiner 4, the dynamic range 
converter 5, the output device 6, and the brightness dis- 
tribution evaluator 7 operate in the same manner as In 
the image-sensing apparatus of the second embodi- 
ment, and therefore no detailed descriptions will be 
given below as to their operation. Now, the operation of 
the black-level and white-level detectors 2 and 3 will be 
described. 

[0048] In the Image-sensing apparatus of this 
embodiment, as shown in Fig. 1 4, on the basis of the 
brightness distribution evaluated by the brightness dis- 
tribution evaluator 7, the black-level detector 2 finds the 
brightness PA1 at which the frequencies of different 
brightness values first reach a predetermined frequency 
H when checked from the lowest brightness PA of the 
brightness distribution upward, and detects the signal 



level at that brightness PAI as the black level BL1 . Sim- 
ilariy, on the basis of the brightness distribution evalu- 
ated by the brightness distribution evaluator 7, the 
white-level detector 3 finds the brightness PBI at which 

5 the frequencies of different brightness values first reach 
the predetermined frequency H when checked from the 
highest brightness PB of the brightness distribution 
downward, and detects the signal level at that bright- 
ness PBI as the white level WL1 . 

10 [0049] The black and white levels BL1 and WL1 
thus detected by the black-level and white-level detec- 
tors 2 and 3, respectively, are then fed to the calculation 
formula determiner 4 to make the calculation formula 
determiner 4 determine a calculation formula to be used 

15 to determine a dynamic range. Subsequently, using the 
thus determined calculation formula, the dynamic range 
converter 5 performs calculation on the Image data out- 
put from the area sensor 1. 

[0050] In this embodiment, the same value H is set 

20 as the predetermined frequency In both the black-level 
and white-level detectors 2 and 3; however, It Is also 
possible to set different values of H for the black-level 
and white-level detectors 2 and 3. 
[0051] As described above, in this embodiment, the 

25 hem portions in which the frequencies of different 
brightness values do not reach a predetermined value 
are removed from the brightness distribution evaluated. 
Thus, even in cases where the brightness distribution 
evaluated has considerably extended hem portions, it is 

30 possible to determine the brightness range of a subject 
properly. The above-described flow of operations per- 
formed in this embodiment may be performed on the 
effective region determined in the fourth embodiment in 
order to determine the brightness range of a subject 

35 and then find the white and black levels WL3 and BL3. 
[0052] In any of the first to fifth embodiments, the 
output device does not necessarily have to be a display 
as specifically named above as an example, but may be 
a storage device or the like that permits storage of 

4o image data on a magnetic disk. Moreover, although all 
of those embodiments deal with an image-sensing 
apparatus for shooting a subject in motion, the present 
invention is applicable also to an image-sensing appa- 
ratus such as a digital camera for shooting a subject at 

45 rest. 

[0053] As described heretofore, when a photoelec- 
tric conversion device of a type that converts logarithmi- 
cally the electric signals produced by photosensitive 
devices Is used, its shootable brightness range Is usu- 

50 ally wider than the actual brightness range of a subject 
that is shot. However, according to the present inven- 
tion, the signal fed from the photoelectric conversion 
device to an output device is subjected to level conver- 
sion In accordance with the brightness range of a sub- 

55 ject so that the dynamic range of this signal is adapted 
to the dynamic range of the output device. By reproduc- 
ing on the output device the signal that has thus under- 
gone level conversion, it is possible to obtain an image 
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with appropriate contrast 

[0054] Although the present invention has been 
fully described In connection with the preferred ennbodi- 
ments thereof with reference to the accompanying 
drawings, it is to be noted that various changes and 
modifications are apparent to those skilled in the art. 
Such changes and modifications are to be understood 
as included within the scope of the present invention as 
defined by the appended claims unless they depart 
therefrom. 

Claims 

1. An image-sensing apparatus comprising: 

a photoelectric conversion device, having a 
plurality of photosensitive devices that produce 
electric signals in accordance with brightness 
of light incident thereon, for converting logarith- 
mically the electric signals produced by the 
individual photosensitive devices; 

a determiner for determining a brightness 
range of a subject; and 

a converter for performing level conversion on 
the electric signals output from the photoelec- 
tric conversion device in such a way that the 
brightness range of the subject as determined 
by the determiner is adapted to a dynamic 
range of an output device used to reproduce an 
image. 

2. An image-sensing apparatus as claimed in claim 1 , 
wherein the determiner determines as the bright- 
ness range of the subject a range from lowest 
brightness to highest brightness represented by the 
electric signals output from the photoelectric con- 
version device. 

3. An image-sensing apparatus as claimed in claim 1 , 
further comprising: 

a brightness distribution evaluator for evaluat- 
ing brightness distribution of the subject by 
measuring frequencies of different brightness 
values sensed by the individual photosensitive 
devices in accordance with the electric signals 
output from the photoelectric conversion 
device. 

wherein the determiner determines the bright- 
ness range of the subject in accordance with 
the brightness distribution evaluated by the 
brightness distribution evaluator. 

4. An image-sensing apparatus as claimed in claim 3, 
wherein the determiner determines as the bright- 
ness range of the subject a range from a first bright- 



ness to a second brightness, the first brightness 
being a brightness at which a value obtained by 
Integrating the brightness distribution with respect 
to brightness from maximum brightness downward 

5 becomes greater than a first predetermined propor- 

tion of a value obtained by integrating the entire 
brightness distribution with respect to brightness, 
the second brightness being a brightness at which 
a value obtained by integrating the brightness distri- 

10 bution with respect to brightness from minimum 
brightness upward becomes greater than a second 
predetermined proportion of the value obtained by 
integrating the entire brightness distribution with 
respect to brightness. 

75 

5- An image-sensing apparatus as claimed in claim 3, 
wherein the determiner determines the brightness 
range of the subject in accordance with a shape of 
the brightness distribution evaluated by the bright- 
20 ness distribution evaluator. 

6. An image-sensing apparatus as claimed in claim 5, 
wherein the determiner calculates an effective 
region of the brightness distribution and an area, 
25 called an effective area, of the effective region in 
accordance with the shape of the brightness distri- 
bution evaluated by the brightness distribution eval- 
uator, and 

wherein the determiner determines as the bright- 
30 ness range of the subject a range from a first bright- 
ness to a second brightness, the first brightness 
being a brightness at which a value obtained by 
integrating that part of the brightness distribution 
which forms the effective region with respect to 
35 brightness from maximum brightness downward 
becomes greater than a first predetermined propor- 
tion of the effective area, the second brightness 
being a brightness at which a value obtained by 
integrating that part of the brightness distribution 
40 which forms the effective region with respect to 
brightness from minimum brightness upward 
becomes greater than a second predetermined 
proportion of the effective area. 

45 7. An image-sensing apparatus as claimed in claim 3 
wherein the determiner determines as the bright- 
ness range of the subject a range from brightness 
at which the frequencies of different brightness val- 
ues first reach a first predetermined frequency 

50 when checked from maximum brightness down- 
ward in the brightness distribution to brightness at 
which the frequencies of different brightness values 
first reach a second predetemnined frequency when 
checked from minimum brightness upward in the 

55 brightness distribution. 

8. An image-sensing apparatus as claimed in claim 1 , 
wherein the determiner determines as the bright- 
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ness range of the subject a range between values 
entered from outside as mininnum and maxinnum 
brightness of the brightness range of the subject. 

9. An image-sensing apparatus as claimed in claim 1 , 5 
wherein the converter performs calculation neces- 
sary to achieve the level conversion of the electric 
signals output from the photoelectric conversion 
device by using minimum and maximum brightness 

of the brightness range of the subject as deter- io 
mined by the determiner. 

10. An image-sensing apparatus as claimed in claim 9, 
wherein the calculation is achieved by converting 
signal levels x of the individual electric signals out- is 
put from the photoelectric conversion device into 
signal levels y using the following formula: 



Ma - Mi , . 



where x represents signal levels of the individual 
electric signals output from the photoelectric con- 
version device, y represents signal levels output 25 
from the converter, Ma represents a maximum level 
that the output device can handle, Mi represents a 
minimum level that the output device can handle, 
BL represents the lowest brightness of the bright- 
ness range of the subject as determined by the 30 
determiner, and WL represents the highest bright- 
ness of the brightness range of the subject as 
determined by the determiner. 



40 
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